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COMMAND REORDERING FOR OUT OF ORDER BUS TRANSFER 

5 BACKGROUND OF THE INVENTION 

The present invention relates generally to graphics display 
systems and methods, and in particular to methods and systems for 
interfacing a graphics system with a weakly ordered bus interface. 

10 In many modern computer or computerized systems the primary 

interface for providing information to a user is a display. 
Information generated by the computer system 1 s processing unit is 
conveyed to the user by means of the display. As computer systems 
have evolved and become ever more capable, increased emphasis has 

15 been placed on the quality of the images displayed, including both 
the quantity of data displayed and the rate at which data on the 
display may change. In order to increase the quality of the 
images displayed without overburdening the computer system's 
processing unit, graphics devices, such as graphics accelerators, 

20 are often used to perform much of the work required to render a 
given image . 

In general, the processing unit, or CPU, determines what 
graphical images should be displayed on a display. The graphics 
device, on the other hand, largely determines how to display the 

25 image. The CPU executes, or runs, a software program such as a 
driver. The driver creates drawing commands to be provided to the 
graphics device. An example of a command is a command to draw 
a triangle. Along with the drawing command, the driver provides 
information, i.e. parameters, that pertains to the command. For 

30 example, the parameters associated with the command to draw a 
triangle could be the vertices of the triangle, and the red, 
green, blue and intensity values of the triangle. The graphics 
device then renders the display by manipulating the drawing 
command and parameters to produce a visual representation, such 

35 as a rendered triangle, on the display. 
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As visual representations have become more realistic, the 
drawing commands and parameters have become more complex. For 

5 example, the drawing command for rendering a three-dimensional 
triangle requires numerous parameters for designating three- 
dimensional spatial locations for each vertex, as well as 
additional shading or texturing information. The large number of 
required parameters for commands, and the rate at which commands 

10 must be propagated from the CPU to the graphics device, place ever 
increasing demands on the CPU, the graphics device, and also the 
communication interface between the CPU and the graphics device. 

The CPU generally communicates with the graphics device over 
a bus. In the past, and in many existing systems, the CPU and 

15 graphics device communicated over a general system bus. Due to 
the high volume of information required to produce high quality 
images, particularly dynamic texturing three dimensional images, 
use of the general system bus inordinately taxes system resources 
and, at times, provides insufficient support of data requirements 

20 for graphics displays. Accordingly, a dedicated CPU to graphics 
device bus is provided by some systems. A dedicated CPU to 
graphics device bus reduces the number of devices competing for 
the use of the bus and thereby provides more bandwidth or space 
on the bus for transferring information to the graphics device. 

25 The dedicated bus, however, does not reduce the large amount of 
information required to be communicated to the graphics device. 
Therefore, with the tremendous amount of information being 
communicated to the graphics device, the importance of efficient 
bus utilization becomes even greater. 

30 One way to reduce the amount of data transferred from the CPU 

to the graphics device is to efficiently encode the command to 
indicate the meaning of parameters pertaining to the command. 
This effectively increases bus bandwidth as less than the complete 
set of possible parameters need be sent from the CPU to the 
35 graphics device every time the CPU issues a new command. Instead, 
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the graphics device determines from the command the meaning of 
parameters provided with the command. This implies, however, that 

5 the parameters bear some predefined relationship to the command. 
An example of such a relationship is that the parameters be 
received by the graphics device in a predefined sequential order 
after receipt of a command. 

Use of write combining (WC) technology is another way to 

10 increase bus bandwidth. An example of WC technology is found in 
the Intel AGP chipset 440BX. Write combining combines individual 
writes to a bus into an aggregation, with each aggregation being 
formed of many individual writes. The order of the individual 
writes, however, is not necessarily maintained. 

15 Thus, if the bus is transmitting information sequentially 

loaded into an area in memory, the order in which the information 
is received may not be the order in which it was sequentially 
loaded into memory. In other words, when using WC the CPU or the 
bus controller does not necessarily transfer information in the 

20 same order as the information is prepared by software executing 
on the CPU, such as the graphics driver. Instead the CPU or bus 
controller may transmit information as it sees fit to increase bus 
efficiency. 

The use of both WC technology and encoded commands to 
25 increase bus bandwidth is therefore problematical. WC technology 
requires that at times information be transmitted in an order 
possibly different than that otherwise expected by the sender. 
The use of encoded commands, on the other hand, requires that 
received parameters be in a predefined order with respect to a 
30 command. Accordingly, methods and systems which overcome the 
obstacles of using of both write combining technology and encoded 
commands are desirable. 



35 
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SUMMARY OF THE INVENTION 

The present invention provides systems and methods of 
increasing effective bus bandwidth through utilization of 
commanding encoding in a weakly ordered bus interface. According 
to the present invention, items of data are written sequentially 
into sequential ordered areas of a memory. The ordered areas of 
memory thereby form command registers, with the registers being 
identifiable by address locations. Thus, each item of data is 
placed in an area of the memory having an associated address. The 
items of data and their associated addresses are transmitted over 
a bus. The items of data and the associated addresses are 
received from the bus, and the addresses for each item of data are 
examined. The items of data are then placed in a storing buffer 
based on the address associated with each item. The placement of 
the items in the storing buffer is accomplished in the same order 
as the items of data were originally written to the sequentially 
ordered areas of the memory. 

The items of data comprise commands and parameters, with each 
parameter, and generally multiple parameters, pertaining to a 
command. The method further comprises examining the items of data 
to determine whether the items of data are commands or parameters, 
as well as determining which parameters pertain to which command. 
The storing buffer may comprise a plurality of storage buffers. 
Each of the storage buffers has two arrays associated with the 
storage buffer. The first array is a read availability status 
array. The read availability status array indicates whether 
locations in the storage buffer contain data available for 
reading. The second array is a direct read status array. The 
direct read status array indicates for each storage location 
within the storage buffer whether data has been directly read out 
to a command interpreter, which may be a burst command interface. 
The direct read status array is useful in that the storage buffers 
may be read out in bulk to a temporary storage facility, which may 
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include a graphics device memory, in order to avoid overflowing 
the command storage buffers as well as to increase system 

5 efficiency. However, there may be times when less than all of the 
command storage buffers have data available for reading, but a sum 
of the storage buffer data should be read. Thus data also needs 
to be provided directly to the command interface, instead of only 
after being stored in the temporary memory. If data is read 

10 directly to the burst command interface, however, then the 
corresponding slots and the other storage buffers should also be 
provided directly to the command interpreter. 

In one embodiment, data received over the bus is split into 
a data portion and an address portion, and routed to a FIFO . The 

15 data portion is routed to the FIFO via multiplexors using portions 
of the address associated with the data to determine the portion 
of the FIFO in which the data should be placed. The FIFO serves 
as an elastic memory such that data may be clocked into the FIFO 
at a bus clock rate, and clocked out of the FIFO at graphics 

20 device clock rate. After data is output from the FIFO the data 
is once again multiplexed, or routed using a router, into a slot 
in the storage buffers, the slot selected based on portions of the 
address information associated with the data item. The data in 
the storage buffers is then provided to a command interpreter for 

25 further processing by the graphics device. 

Many of the attendant features of this invention will be more 
readily appreciated as the same becomes better understood by 
reference to the following detailed description considered in 
connection with the accompanying drawings. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a block diagram of a computer system using 
the present invention; 

35 
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FIG. 2 illustrates a flow diagram of a process for placing 
data in a contiguous memory and sending the data drawing command 
and parameters ultimately to a graphics device; 

FIG. 3 illustrates a block diagram of an embodiment of the 
graphics device of FIG. 1; 

FIG . 4 illustrates a block diagram of an embodiment of the 
decoder/sorter of FIG. 3; 

FIG. 5 illustrates a block diagram of another embodiment of 
the decoder/sorter of FIG. 3; 

FIG. 6 illustrates a block diagram of an embodiment of the 
storing buffers of FIG. 3; 

FIG. 7 illustrates an exploded view of a tag array and a hit 
array showing the relationship of each to a command storage 
buffer; 

FIG. 8 illustrates a flow diagram of a process of decoding 
and sorting received data performed by the decoder/sorter 10 of 
FIG. 3; 

FIG. 9 illustrates a block diagram of an embodiment of the 
command burst FIFO of FIG. 3; 

FIG. 10 illustrates a block diagram of another embodiment of 
the command burst FIFO of FIG. 3; 

FIG. 11 illustrates a flow diagram of a process of 
transferring data to the command burst FIFO from the command 
storage buffers; 

FIG. 12 illustrates a block diagram of an embodiment of the 
data synchronizer of FIG. 3; 

FIG. 13 illustrates a block diagram of another embodiment of 
the data synchronizer of FIG. 3; 

FIG. 14 illustrates a flow diagram of a process of providing 
data to the burst command interface from the data synchronizer; 
and 

FIG. 15 illustrates a flow diagram of a process of reordering 
out of order data according to the present invention. 
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DETAILED DESCRIPTION 

The present invention provides a system and a method of 
increasing effective bus bandwidth utilization by reordering out 
of order data received from a weakly ordered bus interface. 
FIG. 1 illustrates a computer system using the present invention. 
The computer system includes a CPU 1 which communicates with a 
graphics device over a bus 7. A graphics driver program runs on 
the CPU. The graphics driver creates drawing commands and 
parameters utilized in conjunction with the drawing commands. 
The driver arranges the drawing commands and parameters into 32 
bit registers. These 32 bit registers are reserved regions of 
physical memory address space , and in the embodiment of FIG. 1 
are a contiguous region A of system memory 3 or are sequentially 
ordered areas of memory identifiable by address . In the 
embodiment of FIG. 1 the contiguous region A is defined as a 
write combining memory type. Further, the graphics driver 
sequentially writes commands and parameters into sequentially 
increasing address locations of the memory, until an upper bound 
is reached. Once the upper bound is reached, the graphics driver 
begins writing data, i.e., commands and parameters, starting at 
the lower bound when a command is ready to be written. Using the 
bus, the commands and parameters are communicated to the graphics 
device 5, which often includes a co-processor. 

FIG. 2 illustrates a flow diagram of a process to send a 
drawing command and parameters ultimately to the graphics device. 
In step 211, the process checks the amount of graphics data, 
drawing commands and parameters, in the system memory. In step 
213 the process checks if the amount of graphics data in the 
system memory is greater than or equal to 32 DWords. If the 
amount of graphics data in the system memory is greater than or 
equal to 32 DWords, then, in step 216, the process sends the 
graphics data to the graphics device in a burst write 
transaction. A burst write transaction is when all 32 DWords are 
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transmitted over the bus interface in four bus clocks. Further 
burst write transactions will result until all the graphics data 
are transmitted on the bus interface. If the amount of graphics 
data in the system memory is less than 32 DWords, the process in 
step 215 checks if the amount of graphics data is a multiple of 
4 DWords. If the amount of graphics data is a multiple of 4 
DWords, the process, in step 217, sends the data to the graphics 
device in a partial write transaction. A partial write 
transaction is when 1 Dword is transmitted on the bus interface 
in one bus clock. However, if the amount of graphics data is not 
a multiple of 4 DWords, the process in step 219 adds dummy or 
filler data into the system memory up to an amount such that the 
graphics data is a multiple of 4 DWords. In step 217, the 
process sends the graphics data, along with the filler data to 
the graphics device by executing partial write transactions and 
then the process returns. 

FIG. 3 illustrates a block diagram of an overview of a 
receiving portion of the graphics device of FIG. 1. A bus 
interface 7, such as an accelerated graphics port (AGP) interface 
or a peripherals controller interface (PCI), is connected to a 
decoder/sorter 10. The bus interface provides a conduit for 
providing data, commands and parameters, from the CPU (shown in 
FIG. 1) to the graphics device. A detailed description of the 
AGP interface, is described in Accelerated Graphics Part 
Interface Specification, May 4, 1998, the disclosure of which is 
incorporated herein by reference. Further description concerning 
the bus interface, write combining, and connection to peripherals 
such as a graphics device is described in Intel 440 BX AGPset: 
82443BX Host Bridge/Controller, April 1998, and Write Combining 
Memory Implementation Guidelines, November 1998, the disclosures 
of which are incorporated herein by reference. 

The decoder/sorter synchronizes the data to the graphics 
device's clock. The decoder/sorter 10 also determines the order 
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in which the data was written by the graphics driver executing 
on the CPU. The decoder/sorter determines this order by decoding 
the addresses of the received data and storing the data in 
storing buffers 30 based on the decoded addresses. The storing 
buffers are read by a command burst FIFO 70 or a data 
synchronizer 90. The command burst FIFO 70 sends data to the 
data synchronizer 90 and sends 128 bit packed data to a graphics 
memory 110. Graphics data in the graphics memory 110 is also 
sent to the data synchronizer 90 in a 128 bit packed data stream. 
Both the graphics memory and the command burst FIFO are temporary 
storage areas. The data synchronizer 90 selects the appropriate 
data source, the storing buffers 30, the command burst FIFO 70, 
or the graphics memory 110, and sends the graphics data to a 
burst command interface 130. The burst command interface 130 
recognizes the commands and parameters in the received data and 
accordingly provides appropriate information to other portions 
of the graphics device. The burst command interface, which is 
in part a command interpreter, examines the data for a pre- 
defined bit pattern in order to identify a command versus a 
parameter. Once the burst command interface has identified a 
command, the burst command interface determines which other 
portions of the graphics device to which to send commands, the 
appropriate parameters and other instructions. In other words, 
the commands are identifiable by bit patterns in the received 
data, and the commands are pre-enumerated such that the command 
interpreter can determine the parameters which pertain to the 
command. 

FIG. 4 illustrates a block diagram of an embodiment of the 
decoder/sorter 10 of FIG. 3. Data is transmitted over the bus 
interface to a receive FIFO 12. The bus interface may operate 
at a different frequency, such as 33MHz or 66MHz, than the 
circuitry on the graphics device. Accordingly, the receive FIFO 
elastically spans the frequency difference between the bus 



33850/PYI/S696 



interface and the graphics device and thereby acts as a data 
queue. The receive FIFO is 128 bits deep. If 128 bits of data 
are transferred on the bus interface in one bus clock, one bus 
clock fills one entry of the receive FIFO. If only 32 bits of 
data are received in one bus clock, the data is padded with 96 
bits of filler data so that one bus clock fills one entry of the 
receive FIFO. When one entry on the receive FIFO is full, the 
data is transferred to the storing buffers. By regulating the 
flow of data from the bus interface to the storage buffers, the 
receive FIFO synchronizes the frequency of the bus interface with 
the operational frequency of the graphics device. 

The receive FIFO 12 is connected to an address decoder 11 
and a MUX 13. The address decoder 11 decodes the address portion 
of the receive data to determine an address location and sends 
the address location to the MUX 13. The MUX 13 receives a data 
portion, which is 32 bits of graphics data, transferred from the 
bus interface 7 and also receives as a selector the address 
location from the address decoder 11, and the MUX a uses the 
selector to place the graphics data within the storing buffers 
30. 

FIG. 5 illustrates a block diagram of another embodiment of 
the decoder/sorter 10. An address identifier 14 receives 
information from a bus interface, and provides the information 
to a data filler 16 and an address portion to transmit MUX 22. 
The data filler 16 sends 128 packed bits of data to a receive 
packing FIFO 18. The receive packing FIFO 18 sends 128 bits of 
data to a transmit MUX 22. The receive packing FIFO 18 stores 
8 entries, each entry able to store 128 bits of data. Within 
each of the 8 entries, there are 4 sections of 32 bits. As 
previously described, 32 bits of data are sometimes transferred 
over the bus interface in one bus clock. Those 32 bits of data 
are stored in one section of one entry within the receive packing 
FIFO 18. The data filler 16 determines from the address portion 
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of the information which section within the receive packing FIFO 
will store the 32 bits of data. The other 96 bits, out of the 

5 128 bits, of the one entry of the receive packing FIFO are filled 
by the data filler 16 with dummy data, such as all zeros. 

A DWord enable array 20 is associated with each entry within 
the receive packing FIFO 18. The DWord enable array 20 contains 
a DWord enable bit associated with each section within the 

10 respective entry. The DWord enable bit informs the storing 
buffers, that ultimately receive the data, which section contains 
the 32 bits of valid data. Hence, the storing buffers will only 
store the 32 bits of valid data and not store the 96 bits of 
dummy data. 

15 The transmit MUX 22, using the decoded address portion 

provided by the address identifier 14 as a selector, the transmit 
MUX provides the valid data from the receive packing FIFO 18 to 
as a selector storing buffers 30. 

In another embodiment of the decoder/sorter 10, 128 bits of 

20 data are transferred on the bus interface in one bus clock. An 
address portion is sent with each 32 bits of data. Hence, for 
the 128 bits of data transferred, four sets of 32 bits of data 
are included with, respectively, four separate address portions. 
Each address portion determines which section within the receive 

25 packing FIFO to store the 32 bits of data. 

In another embodiment of the present invention, 64 bits of 
data are transferred on the bus interface in one bus clock and 
in another embodiment of the present invention 96 bits of data 
may be transferred on the bus interface in one bus clock. Each 

30 address portion designates which section within the receive 
packing FIFO to store the 32 bits of data. Sections of an entry 
not designated to store data are filled with dummy data. 

FIG. 6 illustrates a block diagram of a detailed view of the 
storage buffers 30 of FIG. 3. Data streams 15A, 15B, 15C, and 
35 15D are inputs into the storing buffers 30. The data streams 
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15A, 15B, 15C, and 15D are connected, respectively, to command 
storage buffers 31, 33, 35, and 37. Each of the command storage 
buffers 31, 33, 35, and 37 are 8 x 32 buffers able to hold 256 
bits of data. Each command storage buffer has an associated 
8x1 tag array, a read availability array, and an 8 x 1 hit 
array, a direct read status array. Thus, command storage buffers 
31, 33, 35 and 37 have, respectively, tag arrays 39, 41, 43, 45 
and hit arrays 47, 49, 51 and 53. Each bit, a read availability 
indicator, of the tag array and each bit, a direct read status 
indicator, of the hit array, are associated with one of the 32 
bit words in the command storage buffers. Each command storage 
buffer 31, 33, 35, and 37 is connected, respectively, to an 
output data stream 55A, 55B, 55C, and 55D whereby graphics data 
is transmitted to either the command burst FIFO 7 0 or the data 
synchronizer 90 . 

FIG. 7 illustrates an exploded view of one of the tag arrays 
39 and its relationship to its respective command storage 
buffer 31. The remaining tag arrays are the same as tag array 
39, and each of these tag arrays bear the same relationship to 
their respective command storage buffers. 

Each tag array is able to hold 8 bits of information. In 
other words, each tag array has 8 tag bits. Each command storage 
buffer contains 8 entries of 32 bits. Each of the 8 tag bits is 
associated with one of the 8 entries in the command storage 
buffer. For example, the first tag bit in the first tag array 
is associated with the first entry of the first command storage 
buffer, and the last tag bit in the first tag array is associated 
with the last entry of the first command storage buffer. 

Each tag bit signifies whether an entry in the command 
storage buffer contains valid data. If a tag bit is set then the 
associated entry contains valid data, and no additional data 
should be written into that entry until the valid data has been 
read. Conversely, if a tag bit is not set then additional data 
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can be written into the associated entry in the command storage 
buffer . 

FIG. 7 also illustrates an exploded view of one of the hit 
arrays 47 and its relationship to its respective command storage 
buffer 31 of the storing buffers 30. The remaining hit arrays 
are the same as hit array 47, and each of these hit arrays bear 
the same relationship to their respective command storage 
buffers . 

Each hit array holds 8 bits of information, or in other 
words has 8 hit bits. Each of the 8 hit bits are associated with 
one of the 8 entries in a command storage buffer. For instance, 
the third hit bit in the second hit array is associated with the 
third entry of the second command storage buffer. Each hit bit 
is used to regulate the flow of graphics data from the storage 
buffers 30 to the command burst FIFO 70 and the flow of graphics 
data from the storage buffers to the data synchronizer 90. The 
detailed operation and relationship of the hit bits to the 
storage buffers is more fully described in conjunction with FIG. 
11. 

FIG. 8 illustrates a flow diagram of a process performed by 
the decoder/sorter 10 of FIG. 3. In step 251, the process 
receives the graphics data from the bus interface. In step 253, 
the process decodes the address information from the data 
received in step 251. Using the decoded address information, the 
process determines which command storage buffer to use to store 
the received data. Further, the process uses the decoded address 
to determine which individual entry within the command storage 
buffer to use to store the received data. 

In the address portion transmitted to the address decoder, 
bits 6 and 5 determine which one of the four command storage 
buffers will be used to store the graphics data. For instance, 
if bits 6 and 5 are both zero, command storage buffer 31 will be 
used to store the graphics data. Furthermore, bits 4 through 2 
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in the address portion determine which one of the eight entries 
in the command storage buffer will store the graphics data. In 
other words, if command storage buffer 31 is identified by bits 
6 and 5 and bits 4 though 2 are zero, then the first entry in the 
command storage buffer 31 is used to store the graphics data. 

Once the process has determined which command storage buffer 
and which individual entry within the command storage buffer is 
to be used for storing the received data, the associated tag 
array is checked by the process in step 255. If the associated 
tag bit is not set, then the process in step 257 will store the 
received data in the command storage buffer. In step 259, the 
process sets the appropriate tag bit in the associated tag array, 
thereby preventing the received data stored in the associated 
command storage buffer from being overwritten and then the 
process ends. If the associated tag bit is set, then the process 
waits, periodically checking the tag bit, until the associated 
tag bit is not set before storing the data into the associated 
command storage buffer in step 257. The process thereafter 
returns . 

FIG. 9 illustrates a block diagram of an embodiment of the 
command burst FIFO 70. The command burst FIFO 70 is connected 
to data streams 55A, 55B, 55C, and 55D from the storing buffers 
30. The command burst FIFO is also connected to the graphics 
memory 110 and to the data synchronizer 90. The command burst 
FIFO further contains a burst FIFO status bit 71. The data 
synchronizer 90 polls or periodically watches the burst FIFO 
status bit 71 to determine if the graphics data within the 
command burst FIFO 70 should be sent to the burst command 
interface. The burst FIFO status bit 71, if set, indicates that 
the command burst FIFO contains graphics data. If the burst FIFO 
status bit 71 is not set, the command burst FIFO is empty. 

FIG. 10 illustrates a block diagram of another embodiment 
of the command burst FIFO 70. In the embodiment of FIG. 10, a 
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16 x 128 transfer FIFO 73 is contained in the command burst FIFO 
70. The transfer FIFO 73 synchronizes the operational frequency 

5 of the command burst FIFO 70 to the operational frequency of the 
graphics memory. Data sent from the storing buffers is stored 
into the transfer FIFO. As the transfer FIFO fills up, data 
within the transfer FIFO is transmitted to the graphics memory 
110. A 16 x 128 return FIFO 75 is further contained in the 

10 command burst FIFO 70. Data sent from the graphics memory 110 
is stored into the return FIFO 75 to be eventually sent to the 
data synchronizer 90. Similarly, like the transfer FIFO 73, the 
return FIFO 75 synchronizes the operational frequency of the 
graphics memory to the operational frequency of the command burst 

15 FIFO. The data within the return FIFO 75 is eventually retrieved 
by the data synchronizer. 

FIG. 11 illustrates a flow diagram of a process in which 
graphics data from the storage buffers 30 is transferred to the 
command burst FIFO 70. In step 301, the process examines the tag 

20 arrays. In step 303, the process determines if the same tag bits 
in each of the tag arrays are set. If none of the same tag bits 
in each of the tag arrays are set, then the process returns. 
However, if the process determines that one or more of the same 
tag bits in each of the tag arrays are set then in step 305, the 

25 process identifies which of the same bits in each of the tag 
arrays are set. In step 307, the process sends graphics data 
from all of the four command storage buffers occupying the same 
entry within each of the command storage buffers to the command 
burst FIFO. For instance, if the tag bit for the fourth entry 

30 is set in all four tag arrays, then the data in the fourth entry 
of all the command storage buffers are transferred to the command 
burst FIFO. In step 309, the process checks for additional 
graphics data to be sent to the command burst FIFO from the 
command storage buffers. If no additional graphics data is ready 
35 to be sent to the command burst FIFO, the process returns. 
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However, if additional data is available to send to the command 
burst FIFO, the process repeats steps 307 and 309 until there is 

5 no additional graphics data to be sent to the command burst FIFO. 
The process thereafter returns. 

FIG. 12 illustrates a block diagram of an embodiment of the 
data synchronizer 90. The data synchronizer 90 is connected the 
storing buffers 30 , the command burst FIFO 70, and the graphics 

10 memory 110. The data synchronizer 90 transmits graphics data 
from either the storing buffers 30, the command burst FIFO 70, 
or the graphics memory 110 to the burst command interface 130. 
The data synchronizer 90 further contains a memory counter 91. 
The memory counter is updated, with a counter increased, for each 

15 transfer of graphics data from the command burst FIFO 70 to the 
graphics memory 110. The memory counter is also updated, with 
the counter decreased, for each transfer of graphics data from 
the graphics memory 110 to the data synchronizer 90. Through the 
use of the memory counter 91, the data synchronizer keeps track 

20 of the amount of graphics data in the graphics memory and thus 
the amount that needs to be retrieved from the graphics memory 
by the data synchronizer. 

Similarly, as previously described in FIG. 8, the data 
synchronizer examines the burst FIFO status bit 71 to determine 

25 if data needs to be shifted out to the data synchronizer from the 
command burst FIFO. Furthermore, through the use of the tag 
arrays, the data synchronizer determines if data should be shifted 
out to the data synchronizer from the storage buffers. For 
instance, if a tag bit is set, data occupies a specific entry 

30 within a specific command storage buffer, as previously described 
and illustrated in FIG. 6. The tag bit, therefore, informs the 
data synchronizer that data is available in the storage buffers 
30 for potential retrieval by the data synchronizer. Accordingly, 
the data synchronizer is able to determine if data needs to be 
35 retrieved from the graphics memory, the command burst FIFO, and 
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the storage buffers by tracking; respectively, the memory counter, 
the burst FIFO status bit and the tag arrays. 

FIG. 13 illustrates a block diagram of another embodiment of 
the data synchronizer 90. In the embodiment of FIG. 13, the data 
synchronizer 90 further contains a Data MUX 93. The Data MUX 93 
acts as a 128 bit interface between the command burst FIFO and a 
32 bit interface for each of the command storage buffers. The 
data from the command burst FIFO is sent to the data MUX. The 128 
bit data sent from the command burst FIFO to the Data MUX is then 
transferred to a data unpacker 95. The data unpacker 95 breaks 
up the 128 bits of data into sequential blocks of 32 bits of data. 
The 32 bits of data are then transferred to the burst command 
interface . 

When no data is left to send to the burst command interface 
from the command burst FIFO, then data from the storing buffers 
30 is sent to the data MUX 93. If the data from the storing 
buffers is larger than 32 bits, the data is sent to the data 
unpacker 95. The data unpacker 95 breaks up the data from the 
data MUX 93 into sequential blocks of 32 bits of data to be 
transferred to the burst command interface. If the data from the 
storage buffers is equal to 32 bits of data then the Data MUX 93 
can transmit the data directly to the burst command interface 130. 

FIG. 14 illustrates a flow diagram of a process the data 
synchronizer performs to shift data out to the burst command 
interface. In step 351, the process determines if graphics data 
is present in the graphics memory. If graphics data is present, 
then in step 357 the process sends the graphics data to the burst 
command interface and repeats step 351. If no graphics data is 
found in the graphics memory, the process in step 353 checks the 
command burst FIFO to determine if graphics data is present. If 
graphics data is present in the command burst FIFO, graphics data 
is sent to the burst command interface by the process in step 357, 
and the process repeats steps 351 and 353. If the process 
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determines that no additional graphics data is present in the 
command burst FIFO, and that no data is present in the command 
burst FIFO after waiting a short latency period, then in step 355 
the process determines if graphics data is present in the storing 
buffers. If in step 355 the process determines that no additional 
graphics data is present in the storing buffers, then the process 
returns. If graphics data is present in the storing buffers, the 
process sets the associated hit bit in the associated hit array 
in step 359 and sends the graphics data to the burst command 
interface in step 361. By setting the hit bit in the hit array, 
the decoder/sorter is prevented from writing graphics data to the 
same entry of the other command storage buffers. Furthermore, 
setting the hit bit prevents the storage buffers from transferring 
the graphics data to the command burst FIFO as 128 bits of packed 
data by transferring the graphics data in the same entry for each 
command storage buffers to the command burst FIFO. In step 363, 
the process checks the same entries within the rest of the command 
storage buffers for additional graphics data. If the process 
finds additional graphics data, then the process repeats steps 359 
and 361. However, if the process does not find additional 
graphics data, then the process in step 365 resets the associated 
hit bits in the associated hit arrays and repeats steps 351, 353 
and 355. 

By resetting the same hit bit for all the hit arrays, the 
decoder/sorter is now allowed to write into the storage buffers 
without any restriction besides that imposed by the tag bits as 
previously described. Also, the storage buffers are allowed to 
transfer graphics data from the same entry of each of the command 
storage buffers to the command burst FIFO as 128 bits of graphics 
data . 

FIG. 15 illustrates a flow diagram of an embodiment of a 
method of reordering out of order bus transferred data. In step 
401, the process receives incoming data from an outside data 
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source through an input/output interface, such as a bus interface, 
and synchronizes the frequency of the bus interface to a graphics 
device. In step 403, the process examines the address information 
transferred with the incoming data. In step 405, the process 
orders the incoming data according to the address information 
examined in step 403. The process in step 405 uses different 
ways of storing information to properly order the incoming data 
and to flexibly accommodate different amounts of incoming data. 
In step 4 07, the process sends the ordered data to the order 
dependent graphics interface and then the process ends. 

Accordingly, the present invention provides systems and 
methods for improved bus utilization through the use of encoded 
commands and received command and parameter reordering. Although 
this invention has been described in certain specific embodiments, 
many additional modifications and variations would be apparent to 
those skilled in the art. It is therefore to be understood that 
this invention may be practiced otherwise than as specifically 
described. Thus, the present embodiments of the invention should 
be considered in all respects as illustrative and not restrictive, 
the scope of the invention to be determined by the appended claims 
and their equivalents rather than the foregoing description. 
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CLAIMS : 

1. A method of providing ordered data to a device over a 
bus with a weakly ordered interface, the bus providing a 
communication path for data and associated addresses, comprising: 

writing items of data into sequentially ordered areas of a 
memory to form a sequence of items of data, the sequentially 
ordered areas of memory being identifiable by addresses, each item 
of data being placed in an area having an associated address; 

transmitting the items of data and the associated addresses 
over the bus; 

receiving the items of data and the associated addresses from 
the bus; 

examining the associated address for each item of data 
received from the bus; and 

placing each item of data received from the bus in one of 
multiple sequentially arranged areas of a storing buffer, each 
item being placed based on the associated address of each item, 
the placement of the items of data forming the sequence of items. 

2. The method of providing ordered data to a device of 
claim 1 wherein the items of data comprise commands and 
parameters, each parameter pertaining to a command. 

3. The method of providing ordered data to a device of 
claim 2 further comprising examining the items of data to 
determine whether the items of data are commands or parameters. 

4. The method of providing ordered data to a device of 
claim 3 further comprising determining which parameters pertain 
to a command. 
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5. The method of providing ordered data to a device of 
claim 4 further comprising reading an item of data from the 
storing buffer. 

6. The method of providing ordered data to a device of 
claim 5 wherein the storing buffer has at least one associated 
read availability status array comprised of a plurality of read 
availability indicators, each of the multiple sequentially 
arranged areas of the storing buffer having a corresponding read 
availability indicator. 

7. The method of providing ordered data to a device of 
claim 6 further comprising setting the corresponding read 
availability indicator of the read availability status array to 
indicate data availability for reading when data is placed in the 
corresponding area of the storing buffer. 

8. The method of providing ordered data to a device of 
claim 7 further comprising setting the corresponding read 
availability indicator of the read availability status array to 
indicate data unavailability for reading when data is read from 
the corresponding area of the storing buffer. 

9. The method of providing ordered data to a device of 
claim 8 wherein storing buffer comprises a plurality of storage 
buffers, and each of the storage buffers has an associated read 
availability status array. 

10. The method of providing ordered data to a device of 
claim 9 further comprising reading an item of data from all of the 
storage buffers and placing the read items of data in a storage 
memory if all of the read availability status arrays indicate 
data available for reading, and reading an item from one of the 
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storage buffers and providing the read item to a command 
interpreter, which performs the steps of examining the items of 
data and determining which parameters pertain to a command, if at 
least one but less than all of the read availability status arrays 
indicate data available for reading. 

11. The method of claim 10 wherein each of the storage 
buffers has an associated direct read status array comprised of 
a plurality of direct read status indicators, each of the multiple 
sequentially arranged areas of the storage buffer having a 
corresponding direct read status indicator, and the method further 
comprises setting the corresponding direct read status indicator 
to indicate a direct read if an item is read from a corresponding 
area of the storage buffer when less than all of the read 
availability status arrays indicate data availability. 

12. The method of claim 11 further comprising setting all 
of the direct read status indicators to indicate not a direct read 
if each of the direct read status arrays indicate a direct read. 

13. The method of claim 12 wherein status of the read 
availability status arrays and the direct read status arrays is 
determined by examining the read availability status arrays and 
the direct read status arrays, and examination and setting of the 
read availability status arrays and the direct read status arrays 
is performed on an indicator by indicator basis. 

14. A method of increasing effective bus bandwidth 
comprising: 

defining a region of a memory as a write combining memory 
type, the region of the memory being comprised of addressable 
locations of processor memory, the addressable locations 
identifiable by an address; 
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writing items of data into the region in a sequential order 
of addressable locations, the items of data comprising encoded 
5 commands and parameters associated with the encoded commands, with 
the number of parameters associated with the command and the 
meaning of parameters in the sequential order indicated by the 
encoded commands; 

providing the items of data and addresses of the items of 
10 data over a bus to a coprocessor; and 

arranging the items of data in an order corresponding to the 
sequential order of addressable locations upon receipt of the 
items of data by the coprocessor. 

15 15. The method of increasing effective bus bandwidth of 

claim 14 further comprising determining which items of data in the 
order corresponding to the sequential order of addressable 
locations are encoded commands and further determining which 
parameters are associated with each encoded command and the 

20 meaning of the parameters based on their position in the order of 
addressable locations. 

16. A bus interface unit of a computer device, the bus 
interface unit coupled to a bus with a weakly ordered interface 
25 providing information comprised of data items and associated 
addresses , comprising : 

a plurality of storage buffers each having a plurality of 
slots for storing data items; 

a first router for routing data items received from the bus 
30 to one of the plurality of storage buffers based on a first part 
of the address associated with the data item; 

a plurality of second routers for each of the storage buffers 
for routing data items routed to a one of the storage buffers to 
one of the slots in the one of the storage buffers based on a 
35 second part of the address associated with the data item. 
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17. The bus interface unit of claim 16 further comprising 
means for providing data items stored in the plurality of slots 

5 to a command interpreter for determining if any of the data items 
corresponds to a command, 

18. The bus interface unit of claim 17 wherein the plurality 
of storage buffers include means for indicating whether each of 

10 the plurality of slots contains data items not provided to the 
command interpreter. 

19. The bus interface unit of claim 18 further comprising 
means for providing data items from one slot of each of the 

15 plurality of storage buffers to a temporary storage area, and 
means for providing data items stored in the temporary storage 
area to the command interpreter. 

20. The bus interface unit of claim 19 wherein the plurality 
20 of storage buffers include means for indicating whether each of 

the plurality of slots contained data provided to the command 
interpreter without the data being first provided to the temporary 
storage area. 

25 21. The bus interface unit of claim 20 further comprising 

a receive FIFO, with the first router routing data items received 
from the bus to one of the plurality of storage buffers by way of 
the receive FIFO. 

30 22. The bus interface unit of claim 21 wherein data is 

received by the bus interface unit at a bus clock rate and the bus 
interface unit operates at the computer device clock rate, and the 
receive FIFO is input data at the bus clock rate and outputs data 
at the computer device clock rate. 

35 
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23. A computer device for reordering incoming data received 
from a bus interface, the incoming data having associated address 

5 information, comprising: 

a receive buffer which receives the incoming data; 
a storage buffer which stores the incoming data in an order 
based on the associated address information; and 

a decoder which determines proper placement of the incoming 
10 data in the receive buffer in the storage buffer based on the 
associated address information. 

24. The computer device of claim 23 wherein the storage 
buffer further comprises a tag array to indicate that data is 

15 stored in a portion within the buffers. 

25. The computer device of claim 24 wherein the storage 
buffer further comprises hit arrays to indicate that data can not 
be stored in a specific portion within the storage buffer. 

20 

26. The computer device of claim 25 further comprising 
graphics memory connected to the storage buffer and able to store 
blocks of data retrieved from the storage buffer. 

25 27. The computer device of claim 26 further comprising: 

a central processor; and 

a computer program executing on the central processor, 
wherein the computer program causing the central processor to send 
the incoming data over the bus interface. 

30 

28 . The computer device of claim 27 wherein the receive 
buffer synchronizer is a FIFO. 

2 9 . The computer device of claim 28 wherein the storage 
35 buffer comprises a plurality of 32 bit DWords. 
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30. A method of reordering incoming data from a data source, 
the incoming data containing address information, the incoming 

5 data being in a predefined order in the data source and being 
transmitted from the data source in an order other than the 
predefined order, the method comprising: 

receiving the incoming data transmitted from the data source; 
arranging, in the predefined order, the incoming data based 
10 on the address information contained within the incoming data; and 
storing the arranged data temporarily. 

31. The method of claim 30 further comprising indicating 
that the arranged data is temporarily stored. 

15 

32. The method of claim 31 further comprising additionally 
storing the arranged data into a series of blocks of contiguous 
data . 



20 33. The method of claim 32 further comprising processing the 

arranged data stored in the pre-defined order. 

34. The method of claim 33 further comprising indicating 
that the arranged data that is temporarily stored is being 
25 processed. 



30 



35 



-26- 



1 33850/PYI/S696 



COMMAND REORDERING FOR OUT OF ORDER BUS TRANSFER 

5 ABSTRACT OF THE DISCLOSURE 

A system and method for increasing effective bus bandwidth 
in communicating with a graphics device. Graphics commands and 
associated parameters are written into a contiguous region of 
system memory and transmitted in a weakly ordered fashion over a 

10 bus to a graphics device. The graphics device reorders the 
incoming data into the same order as which the data was written 
into the contiguous region of system memory, thereby allowing the 
use of order dependent encoded commands with the weakly ordered 
bus interface. 

15 



PYI/nml 

MML PAS167478.4-*-l/22/99 12:02 pm 



20 



25 



30 



35 



-27- 




7 



Bus 

Interface 




FIG. 1 



YES 



216 



BURST 
WRITE 



YES 



PARTIAL 
WRITE 



S 

217 




Start 




i 



DETERMINE THE 

AMOUNT OF 
GRAPHICS DATA 
IN SYSTEM 
MEMORY 



PAD SYSTEM 
MEMORY 



211 




213 



215 



219 




RETURN 




FIG. 2 



FIG. 3 



7 



BUS 
INTERFACE 



10 

A— 



DECODER/ 
SORTER 



V 



30 



STORING 
BUFFERS 



V 



70 



COMMAND 
BURST 
FIFO 




GRAPfflCS 
MEMORY 



s 



110 



BURST 
COMMAND 
INTERFACE 



FIG. 4 



o 

m 
w 

m 

O 

m 
m 

2 

o 

RJ 

m 

J3 



12 



7 



BUS 

interf!ace 



RECEIVE 
FIFO 



10 



V 



13 



MUX 



ADDRESS 
DECODER 



11 



FIG. 5 



10 



7 



14 



16 



V 



ADDRESS 
IDENTIFIER 



BUS 
INTERFACE 



DATA 
FILLER 



y 

X 

V 
-\ 

V 



18 



RECEIVE 
PACKING 
FIFO 



DWORD ENABLE 
ARRAY 




15A 

( 



15B 

-L 



15C 



15D 

L 



TAG ARRAY 1 



S 



HIT ARRAY 1 



39 



47 




COMMAND 
STORAGE 
BUFFER 1 



31 



TAG ARRAY 2 



HIT ARRAY 2 




COMMAND 
STORAGE 
BUFFER 2 



41 

49 
33 



TAG ARRAY 3 



HIT ARRAY 3 



J- 




COMMAND 
STORAGE 
BUFFER 3 



43 



51 



35 



TAG ARRAY 4 



45 



HIT ARRAY 4 



1^53 




^37 



COMMAND 
STORAGE 
BUFFER 4 



30 



55A 




FIG. 6 



55B 




55C 




55D 




0 1 2 3 4 5 6 7 




ARRAY 1 | I 1 | I | | 

0 1 2 3 4 5 6 7 

FIG. 7 



FIG. 8 




Start 




I 



RECEIVE DATA 



I 



251 



DECODE ADDRESS 



I 



253 



CHECK TAG BIT 



I 



255 



STORE DATA IN 
COMMAND 
STORAGE BUFFER 



I 



257 



SET TAG BIT 



I 



259 




RETURN 




FIG. 9 



55A 



55B 





55C 

T2L 




55D 



1 




70 



Z 



COMMAND 
BURST FIFO 



71 



BURST FIFO STATUS BIT 



/ — N 
\ — / 



no 



GRAPHICS 
MEMORY 



90 



DATA 
SYNCHRONIZER 



FIG. 10 



70 



L 



55A 




55B 

^_ 




55C 




55D 



TRANSFER 
FIFO 



73 



75 



RETURN 
FIFO 




110 



GRAPHICS 
MEMORY 



V 



DATA 
SYNCHRONIZER 



90 



FIG. 1 1 




Start 




I 



301 



COMPARE TAG 
ARRAYS 




FIG. 12 



90 



55A 

^_ 




55B 




55C 



1 




55D 



1 





DATA 
SYNCHRONIZER 



91 



MEMORY COUNTER 



COMMAND 
BURST 
FIFO 



70 



A 



110 



V 



GRAPHICS 
MEMORY 



V 



BURST 
COMMAND 
INTERFACE 



130 



FIG. 13 



90 



70 



COMMAND 
BURST 
FIFO 



STORING 
BUFFERS 



30 



93 





DATA 
MUX 



95 



DATA 
UNPACKER 




BURST 
COMMAND 
INTERFACE 



130 



FIG. 14 



357 



1 



SEND DATA TO 
BURST COMMAND 
INTERFACE 




RETURN 




YES 





Start 




I 



SYNCHRONIZE INCOMING 
DATA TO GRAPHICS 
DEVICE 



I 



401 



EXAMINE ADDRESS 
INFORMATION ON THE 
INCOMING DATA 



I 



403 



ORDER INCOMING DATA 
ACCORDING TO ADDRESS 
INFORMATION 



I 



405 



407 



SEND ORDERED DATA TO 
ORDER DEPENDENT 
GRAPHICS INTERFACE 



i 




END 




FIG. 15 



01/22/99 16:16 



NO. 191 P002 



DECLARATION AND POWER OF ATTORNEY PATENT 
FOR PATENT APPLICATIONS 

Docket No. : 33850/PYI/S696 
Attorney : Patrick Y. Ikehara 



As a below named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my name, 

X believe I am the original, first and sole inventor (if only one name is listed below) or an original, first and joint 
inventor (if plural names are listed below) of the subject matter which is claimed and for which a patent is sought 
on the invention entitled COMMAND REORDERING FOR OUT OF ORDER BUS TRANSFER, the specification 
of which is attached hereto unless the following is checked: 

was filed on as United States Application Number or PCT International Application Number and was 

amended on (if applicable). 

I hereby state that I have reviewed and understand the contents of the above -identified specification, including 
the claims, as amended by any amendment referred to above- 

I acknowledge the duty to disclose information which is material to patentability as denned in 37 CFR § 1,56. 

I hereby claim foreign priority benefits under 35 U.S.C. § ll9(a)-(d) or § 365(b) of the foreign application^) for 
patent or inventor's certificate, or § 365(a) of any PCT International application which designated at least one 
country other than the United States, listed below and have also identified below, any foreign application for 
patent or inventor's certificate, or PCT International application having a filing date before that of the application 
On which priority is claimed. 

Prior Foreign Application^) 

Application Number Country Filing Date (dav/month/vear) Priority Claimed 



I hereby claim the benefit under 35 U.S.C. § 119(e) of any United States provisional application^) listed below. 
Application Number Filing Date 



I hereby claim the benefit under 35 U.S.C- § 120 of any United States application^), or any PCT International 
application designating the United States, listed below and, insofer as the subject matter of each of the claims 
of this application is not disclosed in the prior United States or PCT International application in the manner 
provided by the first paragraph of 35 U.S.C. § 112, I acknowledge the duty to disclose information which is 
material to patentability as defined in 37 CFR § L56 which became available between the filing date of the prior 
application and the national or PCT International filing date of this application: 

Application Number Filing Date Patented/Pending/Abandoned 



POWER OF ATTORNEY: I hereby appoint the following attorneys and agents of the law firm CHRISTIE, 
PARKER & HALE, LLP to prosecute this application and any international application under the Patent 
Cooperation Treaty based on it and to transact all business in the U.S. Patent and Trademark Office connected 
with either of them in accordance with instructions from the assignee of the entire interest in this application; or 



-1- 



01/22/99 16:16 NO. 191 P003 



from the first or sole inventor named below in the event the application is not assigned; or from in the event 

the power granted herein is for an application filed on behalf of a foreign attorney or agent. 



K W. Johnston (17,968) 

D. Bruce Prout (20,958) 

Hayden A_ Carney (22,653) 

Richard J. Ward, Jr. (24,187) 

Russell R. Palmer, Jr. (22,094) 

LeRoy T. Rahn (20,356) 

Richard D. Seibel (22, 134) 

Walter G. Maxwell (25,355) 

William P. Christie (29,371) 

David A. Dillard (30,831) 

Thomas J. Daly (32,213) 



Vincent G. Gioia (19,959) 

Edward R. Schwartz (31 } 135) 

John D. Carpenter (34, 133) 

David A. Plumley (37,208) 

Wesley W. Monroe (39,778) 

Grant T. Langton (39,739) 
Constantine Marantidis (39,759) 

John W. Eldredge (37,613) 

Gregory S, Lampert (35,581) 

Craig A. Gelfbund (41,032) 

Syed A. Hasan (41,057) 



Robert D. Rowlett (41,279) 

Kathleen M. Olster (42,052) 

Daniel M. Cavanagh (41,661) 

MoUy A. Holman (40,022) 

Luanda G. Auciello (42,270) 

Norman E. Carte (30,455) 

Joel A. Kauth (41,886) 

Patrick Y. Ikehara (42,681) 

Mark Garscia (Sl,953) 

Gary J. Nelson (P-44,257) 

Raymond R. Tabandeh (P 43,945) 



The authority under this Power of Attorney of each person named above shall automatically terminate and be 
revoked upon such person ceasing to be a member or associate of or of counsel to that law firm. 



DIRECT TELEPHONE CALLS TO : 
SEND CORRESPONDENCE TO : 



Daniel ML Cavanagh, 626/795-9900; 218/681-1800 

CHRISTIE, PARKER & HALE, LLP 
PX). Box 7068, Pasadena, CA 91109-7068 



I declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge 
that willful false statements and the like so made are punishable by fine or imprisonment, or both, under Section 
1001 of Title 18 of the United States Code and that such willful false statements may jeopardize the validity of 
the application or any patent issued thereon. 



Fuji name of sole or first Joint inventor 
Randy X. ZHAO 






Residence and Post Office Address £^ ^ 

40338 San Sebastian Place, Fremont, California, 94539 


Citizenship 
People's Republic of 
China 



Full name of second joint inventor 
Chien-Te HO 




, t Date , 


Residence &nd Post Office Address 

1046 Reed Terrace #4, Sunnyvale, California, 94086 


Citizenship 
People's Republic of 
China 



FvQl name of third joint inventor 
Steve FONG 


IijyAtor^siKnature- 


Date 


Residence and Post Office Address x ~* / Y 
2155 Incline Court, Milpitas, California, 95035 


Citizenship 
U.S. 



NML PAS168420.1.*.l/2l/e9 l.fil pm 



